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SPECIFICATION 

Electronic Version 1.2.8 
Stylesheet Version 1 .0 

[Insert title of invention]MEDIA 
INDEXING BEACON AND 
CAPTURE DEVICE 

Background of Invention 

[0001] The present invention relates generally to indexing of media files and more 
specifically to a technique for automatically associating index information with a 
media file. 

[0002] With the growth of consumer electronic devices, specifically electronic and digital 
devices with recording or capture capabilities, there has been a corresponding 
increase in the number of captured media files. As the number of captured media files 
increases, it become increasingly difficult to remember the content of each file, much 
less organize or search such files based on an understanding of the content of each 
file. Associating index information with each file can facilitate such activities. 

[0003] However, there currently does not exist a cost-effective and time efficient manner 
for indexing multiple media files. One current available method is for an individual to 
create a separate indexing system by manually applying indexing terms to the media 
files. If the indexing terms are maintained in a searchable format, the user may then 
execute searches for pertinent media files. This can be an extremely time-consuming 
task, i.e. for an individual to view, label and index all previously existing media files 
and also view, label and index all future media files when they are provided to a 
secondary storage device. Furthermore, because individual users may create their own 
indexing schemes, complications may arise when users share or exchange various 
media files. 

[0004] 

Another currently available indexing system is for a third party to index a user's 
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media files. Similar to the user-created index system, this process is extremely 
inefficient and time consuming and is therefore a costly endeavor. Moreover, this 
process requires a third party to inspect and catalogue all of a user's media files, 
which may be undesirable and expensive to the user. 

[0005] The capture devices, such as digital cameras and camcorders, for example, may 
provide some relevant indexing information, but this information tends to be limited 
to such data as the date of capture and the device settings used. They may also allow 
the user to manually enter a small amount of additional information. Manual entry of 
the information may be cumbersome and confusing to the typical user. Also, this can 
be a time-consuming task, which provides limited benefit, unless the user provides 
these details for all media files. 

[0006] Another approach to indexing media files employs machine vision techniques to 

recognize certain elements within a photograph or video. Machine visions approaches, 
however, currently are limited in their recognition ability. Even as machine vision 
techniques improve, it remains difficult for machine vision approaches to recognize 
the context of the subjects within the media file. For example, even if a machine 
vision approach could recognize that a photograph depicts a baseball game, it would 
not be possible to recognize that it a specific game, such as a critical play-off game. 

[0007] Therefore, a need exists for a media file indexing system whereupon a media file 
may be automatically indexed, which index is searchable to retrieve pertinent media 
files. 

Summary of Invention 

The present invention provides a system and method for indexing media files. In 
particular, a subject is captured in a media file, such as digital photograph, a motion 
picture, a sound recording, or any other suitable media file as recognized by one 
having ordinary skill in the art. The media file is created using a media capture device, 
such as a digital camera, an audio recording device, a digital camcorder, or any other 
suitable media capture device as recognized by one having ordinary skill in the art. 

The index information is transmitted from a media indexing beacon at a location 
and received by the media capture device. The index information is information 
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related directly to the subject of the media file. In the preferred embodiment, the 
indexing information is descriptive of the subject, i.e. is the semantic content being 
captured in the media file. Once the index information is received and the media file is 
captured, the index information is then associated with the media file. For example, 
the index information can be encoded into a header file on the media file, or stored in 
a separate index file for the media file. Those having ordinary skill in the art will 
recognize that any other suitable means for associating may be used for this purpose. 

[001 0] In one embodiment of the present invention, the media capture device stores the 
media file in a temporary memory buffer, in conjunction with a plurality of other 
media files. When the user wishes to clear the buffer, the plurality of media files 
having index information encoded therein are provided to a media file storage device, 
such as a home computer, a disc drive, a storage drive, or any other suitable storage 
location. The index information associated with the media files allows the user to 
search the plurality of media files, for example the index information may be meta- 
data disposed within the digital file, such as International Press Telecommunications 
Council (IPTC) format, Exchangeable Image File (EXIF) format, or any other suitable 
format as recognized by one having ordinary skill in the art. As such, the present 
invention provides for a system and'method for automatically indexing a plurality of 
media files using a media indexing beacon to transmit index information to a media 
capture device, wherein the media capture device automatically associates the index 
information with the media file. 

[001 1] In the system and method of the present invention, a beacon consists of a device 
that broadcasts information describing, among other things, the location where the 
beacon is placed. The information broadcast may include, but is not be limited to, the 
name of the location, contents of the beacon, the current activities taking place, the 
people who are present (e.g. inspector, engineer, etc.), upcoming and past activities, 
commercial information, such as processes underway and equipment present in an 
industrial setting, transactions that occurred in a retail setting along with product 
information and prices of items present and likely to be depicted in media captured at 
that moment, etc. Media capture devices equipped to receive broadcasts from such 
beacons can then use information received from these beacons to index any media 
captured in the proximity of the beacon. 
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[0012] For example, an indexing beacon placed by Cinderella's castle in Walt Disney 
World might broadcast over a short range that the location is Cinderella's castle, 
weather conditions, and nearby activities, such as a parade or fireworks. For 
commercial information, a beacon in a retail store, such as a furniture store, might 
broadcast the model name of nearby products, such as pieces of furniture and other 
product information, or pointers to product information such as universal resource 
locators (URLs). This information would then be included in the index of the captured 
media. Such indices could be used in applications to continue a process with the 
commercial information, such as a future purchase. For example, after taking pictures 
of furniture in a store, when reviewing pictures at home, a user could then get 
additional information about the pieces depicted and complete a purchase by working 
from the information in the index, such as commercial availability, shipping 
information, related product lines, etc. 

Brief Description of Drawings 

[001 3] The invention will be more readily understood with reference to the following 
drawings, wherein: 

[001 4] FIG. 1 is a block diagram representation of a prior art media file storage system; 

[001 5] FIG. 2 is a block diagram representation of a media file storage system in 
accordance with one embodiment of the present invention; 

[001 6] FIG. 3 is a block diagram of a media indexing system in accordance with one 
embodiment of the present invention; 

[001 7] FIG. 4 is a flowchart illustrating the operation of the media indexing system of FIG. 

3; 

[001 8] FIG. 5 is a block diagram of a media indexing system in accordance with another 
embodiment of the present invention; 

[0019] FIG. 6 is a flowchart illustrating the operation of the media indexing system of FIG. 
5; and 

[0020] 

FIG. 7 is flowchart illustration the operation of the media indexing system of FIG. 
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5 in when the index information is commercial information. 

Detailed Description 

[002 1 ] FIG. 1 illustrates a prior art representation of a plurality of media files, media file 1 
through media file N. Typically, these media files are created by a media capture 
device and then stored in a secondary storage device, such as a computer hard drive, 
a read only memory (ROM), random access memory (RAM), or other suitable memory 
location, as recognized by one having ordinary skill in the art. As indicated in FIG. 1 , 
the subject or content is implicitly encoded within each media file. Therefore an end 
user cannot determine the contents of the file, absent a file-naming system or other 
similar device, without accessing each specific file. 

[0022] FIG. 2 illustrates a plurality of media files 200-208 containing index information, 
in accordance with one embodiment of the present invention. The media files 200- 
208 each include at least one form of index information which is associated with the 
subject of the media file. For example, the media file may contain a family photograph 
taken at a prominent landmark, and the index information may contain two forms of 
index information, a time indicator representing the date and a landmark indicator 
representing the location. 

[0023] Typically, the media files are captured by a media capture device and stored in a 
temporary buffer associated with the media capture device, such as a floppy disc, a 
flash memory, an internal RAM, a recordable disc, or any other suitable memory 
storage device as recognized by one having ordinary skill in the art. The media files 
200-208 are thereupon provided to a secondary storage device, such as a computer 
hard drive, a read only memory (ROM), random access memory (RAM), or other 
suitable memory location, as recognized by one having ordinary skill in the art, where 
the media files are stored in a searchable and retrievable location. 

[0024] 

Table 210 represents a file hierarchy of the stored plurality of media files 200- 
208, wherein the hierarchy provides for a media file indicator 212, the index 
information 214 and the media file content 216. The organization or structure of table 
210 is for illustrative purposes only; those having ordinary skill in the art will 
appreciate that other techniques for storing the media files, wherein the media files 
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may be readily searched and pertinent files accessed, may be equally employed. The 
media files 200-208 may be stored across multiple memory locations and 
furthermore may be stored across multiple interconnected computing devices, i.e. 
stored in a centralized or distributed fashion. 

[0025] FIG. 3 illustrates a media indexing system 300, in accordance with one 

embodiment of the present invention. The system of FIG. 3 represents a push- 
technology embodiment, wherein index information is pushed from a media indexing 
beacon 302 to a media capture device 304. The media indexing beacon 302 
comprises index information buffer 306, composed of at least one index information 
308, such as a time indicator indicating the date and time, a landmark indicator 
indicating an actual location or landmark where the media indexing beacon is 
positioned, an event indicator indicating a specific event that is occurring, such as 
based on the time indicator, a global position indicator which indicates specific global 
positioning coordinates, a proximity indicator that indicates a nearby location or 
event, or any other indicator as recognized by one having ordinary skill in the art. In 
general, the index information comprises any information that, when associated with 
a media file, would be useful for performing the above-described operations, i.e. 
searching, categorizing, etc. 

[0026] Another example of index information is commercial information, which 

comprises information related to commercial activity, such as information relating to a 
particular retail item, information relating to product availability, pricing, shipping 
information, a universal resource locator (URL) to access further information, such as 
via a company website. Another example is index information compatible with a 
software package whereupon a user may directly order or conduct further commercial 
business through the media indexed file using the referenced index information 
provided by the media indexing beacon 302. 

[0027] 

The index information 308 is provided to a converter 31 0 via connection 312. The 
converter 310 converts the index information 308 into transmittable format and 
provides the index information to a transmitter 314 via connection 316. The 
transmitter 314 transmits the index information 308 to the media capture device 304 
via communication path 31 8 to an index information receiver 320 disposed within the 
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media capture device 304. 

[0028] The transmission from the media indexing beacon 302 to the media capture 
device 304 may utilize a wireless networking standard, such as Bluetooth, IEEE 
802.1 1 , or other recognized wireless networking standards. The transmission may 
also utilize other recognized wireless transmissions, such as an infrared beam, a radio 
wave or other recognized wireless transmission standards. Although, it may be 
recognized by one having ordinary skill in the art, the communication path 318 is 
preferably a wireless transmission, wired transmissions, such as using a coaxial cable 
or a digital line, are within the scope of the present invention. 

[0029] Within the media capture device 304, the index information receiver 320 receives 
and decodes the index information and provides the index information to an index 
information buffer 322, via connection 324. The index information is stored within the 
buffer 322 until a processor 326 retrieves the index information, in conjunction with 
capturing a subject in a media file via the media input module 328, such as a digital 
camera lens and associated hardware, a microphone; or other recognized media input 
modules used to capture a media file. 

[0030] The index information is provided to the processor 326 via connection 330 and 

the captured media file is provided to the processor 326 from the media input module 
328, via connection 332. The processor 326 processes the media file and associates 
the index information therewith. As recognized by one having ordinary skill in the art, 
the index information may be associated with the media capture device utilizing 
different approaches, such as actually writing the index information into the media 
file, generating a pointer file within the media file to reference the index file, 
generating an index file naming scheme wherein the index file name corresponds to 
the media file name, or any other association approach wherein the index information 
is denoted as corresponding to the subject of the media file. 

[0031] media file, having index information associated therewith, is then provided to 

a memory 334 via connection 336. In one embodiment, the index information and the 
media file are stored within the memory 334 at substantially the same time. The 
memory 334 within the media capture device 304 is typically a temporary memory 
where the media files are stored until they are provided to a media file storage device 
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338, via connection 340. Stored in the memory, 334 or 338, is a data structure where 
the data structure comprises a media file of the subject captured by the media capture 
device and a plurality of index information provided from the media indexing beacon 
relating to the subject. 

[0032] The media file storage device 338 stores the media files where they may later be 
accessed. The media file storage device 338 is coupled to an interface 342. The 
interface 342 may allow for the searching of the media files or enablement of a 
commercial system. For searching, the interface 342 may receive search criteria 
corresponding to the index information and for enabling of a commercial system, the 
interface 342 may provide media files to a processing system based on index 
information. Thereupon, the media files within the memory 338 may be accessed 
using the search criteria, allowing for the retrieval of pertinent media files wherein the 
index information is automatically associated with the media file. 

[0033] As recognized by one skilled in the art, the media indexing beacon 302 and the 
media capture device 304 contain other components, which have been omitted for 
clarity purposes only. Furthermore, in the system of FIG, 3, the indexing beacon 302 
acts as a beacon, providing a continuous output of standard index information, 
whereupon the media capture device receives and utilizes the index information in 
conjunction with capturing a media file. 

[0034] FIG. 4 illustrates a flowchart representing the operation of the media indexing 
system of FIG. 3. The media capture device 304 captures a subject in a media file, 
step 402. The subject of the media file may be a landmark, an event, a person or 
groups of persons at the landmark or event, a sound recording, or any other 
recognizable subject matter for a media file. The media file is captured using the 
media input module 328 within the media capture device 304. 

[0035] Next, step 404, index information relating to the subject in the media file is 

received from the media indexing beacon 302. As discussed with reference to FIG. 3, 
the index information is provided from the transmitter 314 to the index information 
receiver 320, via transmission path 318. The index information is then associated with 
the media file, designated at step 406, wherein the processor 326 attributes the index 
information to the subject of the media file for indexing purposes. 
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[0036] 



Once the media file and index information have been associated, in one 



embodiment of the present invention, the index information is encoded within the 
media file, designated at step 408. The index information may be encoded by writing 
the index information into a header portion of the media file, creating a separate 
index directly with a direct link to the media file, writing the index information into 
the media file itself, or any other recognized encoding techniques. 

[0037] The media file and index information is thereupon provided to a media file 

storage device 338, designated at step 41 0. As discussed above, with reference to 
FIG. 3, the plurality of media files may be searched within the media file storage 
device using the index information associated therewith or enable a commercial 
system using the index information within the plurality of media files, step 412. The 
user may use a search engine to retrieve at least one pertinent media file, based on 
the index information. For example, using the digital camera as an example of the 
media capture device and digital photographs as media files, the user may wish to 
search for all digital photographs relating to a trip to a specific landmark at a specific 
time. The user may enter the location and date into the search engine, and all digital 
photographs having matching index information are deemed pertinent and provided 
to the user. 

[0038] FIG. 5 illustrates a media indexing system 500, in accordance with another 
embodiment of the present invention. The system of FIG. 5 represents a pull- 
technology embodiment, wherein index information is pulled from a media indexing 
beacon 502 in response to a request from a media capture device 504. Similar to the 
push-technology embodiment, the media indexing beacon 502 contains index 
information buffer 506, comprising at least one index information 508, wherein the 
index information 508 is similar to the index information 308 of the push-technology 
media indexing beacon described above with reference to FIG. 3. 

[0039] The index information 508 is provided to a converter 510 via connection 512. The 
converter 510 converts the index information into transmittable format and provides 
the index information to a transmitter 514 via connection 516. In the pull-technology 
embodiment, the media indexing beacon 502 further contains a receiver 518 operably 
coupled to the transmitter 514 via connection 520. 
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[0040] The media capture device 504 is similar to the media capture device 304 of the 

push-technology embodiment, wherein the media capture device 504 further contains 
an index information transmitter/receiver 522. The index information 
transmitter/receiver 522 provides an index information request to the media indexing 
beacon 502 via communication path 524. The receiver 51 8 receives the request and 
activates the transmitter 514. The transmitter 514 thereupon transmits the converted 
index information to the index information transmitter/receiver 522 within the media 
capture device 504, via connection 526. The transmissions between the media 
indexing beacon 502 and the media capture device 504 may utilize a wireless 
networking standard, such as Bluetooth, IEEE 802.1 1, or other recognized wireless 
networking standards. The transmission may also utilize other recognized wireless 
transmissions, such as an infrared beam, a radio wave or other recognized wireless 
transmission standards. Although, it may be recognized by one skilled in the art, the 
communication paths 524 and 526 are preferably wireless transmissions, but wired 
transmissions, such as using a coaxial cable or a digital line, are within the scope of 
the present invention. 

[0041] The media capture device 504 also contains a user input 528, such as a record 
button, which is operably coupled via connection 530 to a processor 532. The 
processor 532 receives the user input and provides an index information request to 
the index information transmitter/receiver 522 via connection 534. As described 
above, the index information transmitter/receiver 522 receives the index information, 
which is thereupon provided to an index information buffer 536 via connection 538. 

[0042] The processor 532 also sends a media file capture request to a media input 

module 538 via connection 540. The media module input 538 thereupon captures a 
subject in a media file and provides the media file to processor via path 542. The 
processor also receives the index information from the index information buffer 536 
via path 544. 

[0043] 

The processor associates the index information with the media file and provides 
the media file having index information associated therewith to a memory 546, via 
connection 548, within the media capture device 504. The memory 546 may store a 
plurality of media files having index information associated therewith. The plurality of 
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media files may thereupon be provided to a media file storage device 548 via path 
550.The media file storage device 548 stores the media files where they may later be 
accessed. The media file storage device 548 is coupled to an interface 5 52. The 
interface 5 52 may receive search criteria corresponding to the index information or 
provide media files to a processing system. Thereupon, media files within the memory 
548 may be accessed using the search criteria, allowing for the retrieval of pertinent 
media files wherein the index information is automatically associated with the media 
file or a commercial system may be enabled using the index information within the 
stored media files. 

[0044] As recognized by one skilled in the art, the media indexing beacon 502 and the 
media capture device 504 may contain other components, which have been omitted 
for clarity purposes only. Furthermore, in the system of FIG, 5, the indexing beacon 
502 acts in response to a request from the media capture device 504, whereupon the 
media indexing beacon 502 provides the index information to the media capture 
device 504 upon request and in conjunction with the capturing of a media file. 

[0045] FIG. 6 illustrates a flowchart representing the operation of the media indexing 

system of FIG. 5. The media capture device receives a user input to capture a subject 
within a media file, step 602. As illustrated in FIG. 5, the user input is provided to the 
processor 532 via path 530. The media capture device 504 then transmits an index 
information request from the index information transmitter/receiver 522 to the 
receiver 518 within the media indexing beacon 502, designated at step 604. 

[0046] Next, the receiver 51 8 sends a transmit signal across path 520 to the transmitter 
514, step 606. The transmitter 514 thereupon transmits the index information to the 
index information transmitter/receiver 522 within the media capture device, 
designated at step 608. Thereupon, index information is provided to the processor 
532 via the index information buffer 536, step 612. 

[0047] The media capture device also, in response to the user input in step 602, captures 
a subject in a media file using the media input module 538, step 61 2. Thereupon, 
step 61 0, the media file is also provided to the processor 532 within the media 
capture device 504. 
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[0048] The processor 532 then associates the index information with the media file, step 
614, similar to step 406 of FIG. 4. The media capture device captures a plurality of the 
media files, wherein the media files are stored in the memory 546. The media files 
having the index information associated therewith are distributed to the media file 
storage device 548, designated at step 616. 

[0049] In utilizing the index information of the media files, the plurality of media files 
may be searched, using the index information to retrieve pertinent media files, step 
61 8. As described above, the user may enter specific index indicators, such as time, 
location, event, etc. and the plurality of media files are searchable based on the index 
information. When pertinent media files (files having matching or corresponding index 
information) are found, the pertinent media files may then be provided to a media 
output device step 620, such as a computer monitor, an audio speaker, or any other 
type of output device as recognized by one having ordinary skill in the art. 

[0050] FIG. 7 illustrates another embodiment of the operation of the media indexing 
system of FiG. 5, wherein the index information is commercial information. Steps 
702-716 are substantially identical to steps 602-616, therefore a discussion of these 
steps is omitted for clarity purposes only. Thereupon, in step 71 8, a commercial 
system is enabled with the plurality of stored media files using the index information. 
Using the example of a retail store, media files of various items may be captured 
within the store, wherein the media files contain associated index information from a 
media indexing beacon. Through the interface 5 52, a commercial system, such as 
computer program, may utilize the media files to enhance the retail experience. A 
commercial transaction, designated at step 720, may be completed in response the 
indexing information from the media files as used by the commercial system. 

[0051] Referring back to FIGS. 3 and 5, the media indexing beacons 302 and 502 

generally disclose a means for storing the index information 306 and 506 and a 
means for transmitting a beacon signal using a transmitter 314 and 514. As discussed 
above, the beacon signal comprises index information relating to a subject that may 
be captured by the media capture device. 

[0052] Within the media capture device, the media input modules 328 and 538 generally 
disclose a means for capturing the subject in a media file. The index information 
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receiver 320 and the index information transmitter/receiver 522 generally disclose a 
means for receiving the index information from the means for generating the beacon 
signal containing the index information therein. The processor 326 and 532 generally 
disclose a means for associating the index information with the media file, wherein 
the function of associating is consistent with the above discussion. 

[0053] As discussed above, the index information may be any type of information used to 
derive improved benefit from and accessibility to the various media files. The index 
information may be personal information used to categorize and make searchable a 
plurality of media files, or in another example, the index information may be 
commercial information used to further a commercial transaction. Where the index 
information is commercial information, the media file having the index information 
contained therein may be used by a retail sales system, such as an interactive 
program connected to a retail establishment's dedicated server or company website to 
initiate, continue, or enhance a commercial sales transaction. 

[0054] In another example, a plurality of media files may be used in another commercial 
system, such as a workflow system. In this embodiment, media files of various 
workflow stations may be acquired with index information associated therewith, where 
the index information relates to a particular step within a workflow process. The 
plurality of media files may also be used within a procurement system, similar to a 
retail system, wherein a buyer may acquire media files of different available items 
from different suppliers and utilize these media files having index information 
associated therewith in the procurement system to quickly order items from at least 
one supplier. In this embodiment, the index information may be information relating 
to item availability, shipping time and costs, advantages over related items from other 
suppliers, supplier contact information, URLs to related online locations, such as the 
suppliers website, recommendations for associated items, etc. 

[0055] 

Yet another commercial system which may utilize a plurality of media files having 
media index information associated therewith is a safety inspecting/auditing system. 
For example, a facility may be inspected for different certification requirements, such 
as OSHA requirements or quality control requirements, wherein an inspector may 
acquire a plurality of media files with index information automatically associated 
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therewith from multiple media indexing beacons. At a later point in time, the media 
files may be supplied to an auditing system wherein the inspection may be finalized. 
In one example, specific machines within a factory may contain an indexing beacon 
that contains index information relating to when the machine was last serviced, 
average production speed, time and duration of any down periods, equipment 
operator credentials, or any other information which may be used for an 
inspection/audit of a facility. 

[0056] As recognized by one having ordinary skill in the art, media files having index 
information associated therewith may be utilized in further commercial systems not 
explicitly listed herein. As such, the above discussion provides examples of different 
types of commercial systems but the present invention is not limited in this regard. 

[0057] The present invention provides for a method and system for indexing media files 
based on a subject within the media file. The subject within the media file may be a 
location, a date or time, an event, or any other indicative component used to 
distinguish different media files. The present invention provides for the automatic 
indexing of the media files based on the association of the media file with the index 
information. The media file is thereupon stored and the associated index information 
is searchable such that the user may retrieve pertinent media files. The present 
invention allows a user to effectively index a plurality of media files without having to 
engage in further activities, beyond capturing the media file itself. 

[0058] It should be understood that implementation of other variations and modifications 
of the invention in its various aspects may be readily apparent to those of ordinary 
skill in the art, and that the invention is not limited by the specific embodiments 
described herein. It is therefore contemplated to cover, by the present invention any 
and all modifications, variations or equivalents that fall within the spirit and scope of 
the basic underlying principles disclosed and claimed herein. 
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